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Preface 



Over the past four years, calls to investigate and improve the 
quality of higher education have rapidly escalated. Among 
the most visible and insistent have been initiatives aimed at 
determining the outcomes of undergraduate instruction. 
The resulting "assessment movement" has become a nation- 
al phenomenon-embracing activities as diverse as state 
programs to determine the basic skills of entering freshmen, 
state and accreditation-based efforts to encourage colleges 
and universities to broadly investigate undergraduate out- 
comes, and a range of institutional efforts including testing, 
student surveys, and program evaluation. 

Despite considerable activity, evidence about the relative 
effectiveness of assessment efforts remains scanty. Partly this 
is because most are new and have consequently had little op- 
portunity to show results. Partly it is because documenta- 
tion of both the benefits and the costs of "assessment" 
remains elusive. Within these substantial limits, the purpose 
of this monograph is to analyze and discuss what is current- 
ly known about the benefits and costs of assessment 
programs. The result should be a framework that can be ap- 
plied by both institutional and state-level academic ad- 
ministrators as they consider which kinds of assessment aj> 
proac js best fit their own needs and conditions. 
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Assessment in Higher 
Education: Some 
Background 



Current interest in assessing the outcomes of undergraduate 
education is rooted in two simultaneous but independent 
developments. The first is reemerging concern about the 
structure and content of the undergraduate curriculum. 
Partly fueled by national investigations of deficiencies in 
elementary and secondary education (for example the Na- 
tion at Risk report issued by the U.S. Department of Educa- 
tion in 1983), a number of reform proposals directed toward 
improving undergraduate education emerged in 1984-85. 
Among them were Involvement in teaming (the report of 
the National Institute of Education's Study Group on the 
Conditions of Excellence in American Higher Education), In- 
tegrity in the College Curriculum (issued by the American 
Association of Colleges), To Reclaim a Legacy (a report of 
the National Endowment for the Humanities), and Access to 
Quality Undergraduate Education (issued by the Southern 
Regional Education Board). 
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The consensus of these reports-origi nating for the most 
part from within the academic establishment-was that un- 
dergraduate instruction was in need of considerable over- 
haul. Particularly recommended were (1) greater curricular 
coherence with respect to curricular content and structure, 
(2) higher expectations and standards, (3) greater oppor- 
tunity for active student involvement in learning, (4) im- 
proved capabilities to identify and remediate learning 
deficiencies in incoming students, and (5) better 
mechanisms for providing "feedback" on learning to stu- 
dents, faculty and administrators in order to guide improve- 
ments. It is important to note that only the last trvo of these 
directly embrace "assessment" as it is currently understood. 
And both go considerably beyond the notion of collecting 
information on undergraduate student performance by 
stressing the actual uses to which such information will be 
put. Effective "assessment" in this tradition is institution- 
specific and emphasizes the con tinuous improvement of stu- 
dent performance. It is integrated and Faculty-centered, 
employing multiple methods, and linked as fully as possible 
to the day-to-day fabric of institutional decisionmaking. 

A second stimulus for "assessment" is increased pressure 
for accountability with regard to public funds invested in 
higher education. One component concern is the escalating 
cost and complexity of public postsecondary education. 
Both legislators and governors have become increasingly 
sensitive (especially in tight budget years) to the fact that they 
know very little about the actual impacts of investments that 
can consume substantial proportions of state general 
revenue funds each y *ar. At the same time, higher education 
leaders have become more sophisticated in their claims 
about public benefit (Ewell 1990). Links between proposed 
investments in public higher education and statewide 
economic development-particularly in high technology 
areas-have become increasingly visible in the past decade. 
Both trends have focused the attention of officials and the 
wider public more explicitly on higher education's overall 
return on investment. In the mid-eighties, these concerns 
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also spawned a series of national reports-prominently 
among them Transforming the State Role in Undergraduate 
Education: Time for a Different View (issued by the Educa- 
tion Commission of the States) andTime for Results (a report 
of the Task Force on College Quality of the National 
Governors Association). 

Like the "academic improvement" reports that preceded 
them, these "reform" documents called for more and better 
data about the results of undergraduate study. In addition, 
however, they recommended that such information (1) be 
publicly available and comparable across institutions, (2) be 
used to inform policy and resource allocation decisions at 
the state level, and (3) be appropriate to inform "consumer 
choice" on the part of students and their parents in the 
decision of which college to attend. Effective "assessment" 
within this tradition emphasizes demonstrable return on in- 
vestment with respect to student outcomes. To be maximal- 
ly credible, assessment techniques are expected to be 
straightforward and easily understood, and should if pos- 
sible result in quantitative indicators of program perfor- 
mance. While academic improvement remains a goal, it is to 
be achieved primarily through the action of external market 
forces informed by assessment results, and through the ap- 
plication of direct sanctions and incentives applied to higher 
education institutions through their governing and 
regulatory bodies. A major policy alternative here is "perfor- 
mance funding": those institutions best demonstrating their 
"effectiveness" vM! derive commensurate rewards in the form 
of additional resources. An alternative fx)licy choice is 
directed investment: here marginal resources are directed 
toward particular institutions to address designated 
problems or deficiencies which assessment reveals. 

Together, institutional and state policy developments 
have stimulated an immense variety of "assessment" initia- 
tives. Because of the sheer range of alternatives, some 
specification of the types of programs currently being under- 
taken is an important prerequisite for a discussion of costs 
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and benefits-both of which will vary widely depending on 
program scope, intent, location, and methodology. 

1. State Approaches to Assessment: Currently, some 
twenty-seven states have established identifiable "assess- 
ment programs" through Board resolution, executive direc- 
tive, or statute (Ewell, Finney and Lenth 1990). Such initia- 
tives are expected or planned in an additional dozen states 
over the next five j .ars. State approaches to assessment dif- 
fer widely, and include one or more of the following ac- 
tivities (Ewell and Boyer 1988): 

common statewide testing of the basic skills of in- 
coming college freshmen (in place in Florida, New 
Jersey, Texas, and Tennessee). 

common statewide testing of college students for 
purposes of promotion (Florida, Georgia), to deter- 
mine undergraduate program effectiveness (New Jer- 
sey, Tennessee; discontinued in South Dakota after 
3 years), and/or to allocate resources to institutions 
(Tennessee). 

a requirement that each institution submit and 
receive approval for a local "assessment plan" to col- 
lect information on undergraduate outcomes consis- 
tent with institutional mission (in place in Arizona, 
Colorado, New Jersey, Virginia, South Dakota, Mis- 
souri, Hawaii, Georgia, Wisconsin, South Carolina, 
Washington, New York, Kansas and several other 
states). In some cases, as in California or Vermont, 
only one institutional sector is involved; in many 
cases, plan approval by a state governing or coor- 
dinating board is in some way linked to institutional 
funding. 

States have also exhibited widely varying levels of invest- 
ment in such programs. In many cases, no new dollars are 
associated with the mandate. In others, categorical grant 
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programs have been used to support "demonstration 
projects" at individual institutions* In a few cases, substan- 
tial new dollars have been invested at the state level (in New 
Jersey, |850,00O/year for college outcomes, $500,000/year 
for basic skills assessment in 1988*89; in Virginia, institution- 
al grants of 110-12/FTE student at all public institutions in 
the 1998-90 biennium). 

2. Institutional Approaches to Assessment; Partly in 
response to emerging state mandates-most of which assign 
responsibility for designing and carrying out assessment and 
evaluation activities to individual campuses-the past five 
years has also seen development of a considerable range of 
institutionally-based assessment efforts. Before 1984, the 
number of institutions possessing identifiable "assessment 
programs" was extremely small. Best current estimates indi- 
cate that up to 70 percent of American colleges and univer- 
sities are establishing such programs-most of them in the 
past two or three years (for example, Hyman et al. 1988; Kl- 
Khawas 1989). Additional national survey data (for example, 
Hl-Khawas 1988) indicates widespread attention to the issue, 
and substantial expectations that assessment prog^ms will 
be implemented in some form on virtually all public cam- 
puses. 

In establishing the range (and cost) of such initiatives, it 
is important to stress that many existing institutional data- 
collection activities may be in (uded among them. As a 
result, costs and benefits of explicitly establishing an "assess- 
ment program" must be calculated on the margin-after 
taking into account these already existing activities. Prior to 
the emergence of assessment as an issue, most colleges and 
universities collected considerable evaluative information 
about students through a variety of mechanisms (Ewell 
19M), Most common are diagnostic testing to determine 
weaknesses in basic skills and occasional opinion surveys 
designed to determine . tudent satisfaction with campus ser- 
vices. Mat institutions also collect a range of demographic 
and course performance information about their students, 
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embodied in computerized student record systems. 
Generally lacking, however, and explicitly addressed by an 
identifiable institutional assessment program, are (a) infor- 
mation on the effectiveness of the curriculum as a whole as 
determined by changes in overall student knowledge and 
skill levels and (b) an institutional mechanism for integrat- 
ing scattered information on institutional effectiveness and 
using this information systematically to improve instruction. 

While details of emerging institutional assessment 
programs vary widely, most contain sufficient common fea- 
tures to allov meaningful comparison and to support 
limited generalizations about costs and benefits. Fartly this 
is because most such programs have bee n modelled on a few 
widely quoted examples-most prominently for public in- 
stitutions, Northeast Mr'ouri State University and the 
University of Tennessee, Knoxville, and most prominently 
for private institutions, Alverno College. Partly this unifor- 
mity is also due to the fact that the majority of recently es- 
tablished programs were developed in response to state 
guidelines which strongly resemble one another-most 
notably in Virginia, Colorado, and New Jersey. Among the 
common emerging features of institutional assessment 
programs are the following (Ewell 1987): 

An identified office or individual assigned ex- 
plicit responsibility for coordinating ; tot assess- 
ment function, for advising individual academic 
units in designing assessment and evaluation 
procedures, and for helping to interpret obtained 
results for decisionmaking. Generally this office 
or individual is given an identifiable budget for the 
activitv-a budget that often reflects reallocation of 
existing information functions as well as the funding 
required for new activities. Reporting lines vary con- 
siderably, but generally locate the function in close 
proximity to the institution's chief academic olH^Ci 
While recruitment of an evaluation/assessment 
specialist to manage this function is occurring with 
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increasing frequency, the most frequent occurrence 
is reassignment of a faculty member in education or 
social science to manage the activity. 

Basic skills testing in reading, writing, and com- 
putation for entering freshmen. Generally this is 
an existing activity, reassigned to or coordinated by 
the assessment function. At the *ame time when an 
explicit assessment program is adopted, changes in 
this function are often made to render it more sys- 
tematic. These include, 

• ensuring that all entering students are tested 
(often they are not, as they can "place out" of such 
testing by high school record or SAT/ACT perfor- 
mance- neither of which provide a good guaran- 
tee that students in fact possess the required 
skills); 

• use of common test instruments (often a range of 
instruments are used for different types of stu- 
dents with noncomparabie characteristics and 
results); 

• mandatory placement of students into remedia- 
tion when deficiencies are identified (often stu- 
dents are "advised" to take certain remedial cour- 
ses but in fact do not do so); 

• ret^sting students as a condition for exiting 
remediation using the same tests or instruments 
that resulted in the initial determination of 
deficiency (often students so tested after "com- 
pleting" remediation still cannot perform effec- 
tively enough to do college level work). 

Such changes will generally considerably alter 
the chai after and effectiveness of basic skills testing 
programs, as shown most recently by Texas' 
Academic Skills Program (TASP) which mandates all 
four activities on a statewide basis. 



Evaluation of the effectiveness of "general educa- 
tion/ by looking at the development in students 
of such integrative skills as critical thinking and 
problem solving. For most institutions, this is an 
entirely new activity, as the only existing information 
will be student course grades }•> general education 
courses. Common prac' :es include, 

• administration of one or more standardized ex- 
aminations to samples of students at the end of 
the sophomore or senior years to determine 
growth, 

• design and implementation of locally-designed 
examinations and exercises that require students 
to use knowledge in an integrated fashion to 
solve problems, 

• collection and analysis of existing examples of 
student work produced naturally throughout the 
curriculum in the form of "portfolio" or "secon- 
dary reading" techniques, 

• special surveys and course evaluations that tap 
student perceptions about the effectiveness of 
general education. 

Evaluation of the effectiveness of instruction in 
the student's major Held. The degree to which this 
is a new activity depends upon the field of study. In 
most professional or occupational fields, existing 
certification, licensure, or accreditation procedures 
demand such assessment. In most traditional 
academic disciplines, no such procedures are typical- 
ly in place. Consequently, establishing an explicit as- 
sessment program in this area generally entails, 

• ensuring that all fields undertake a periodic ex- 
amination of this type (usually every five to seven 
years), 
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• ensuring that most of the knowledge and skills 
objectives that the program claims to develop are 
in fact assessed in some way, 

o determining the success of graduates in employ- 
ment and further study. 

Often these activities are made a part of existing 
program evaluation processes. Generally they re- 
quire departments and programs to work individual- 
ly, with limited funding and technical assistance 
provided through the institution's assessment 
program. 

Determination of student satisfaction and be- 
havior through periodic surveys. Depending upon 
past institutional practice, this can imply a reassign- 
ment Oi a wholly new activity. Generally responses 
are sought from both current and former students, 
and involve, 

• personal goals and goal fulfillment attained 
through attendance at the institution, 

• student reactions to and satisfactions with 
various aspects of the instruction and services 
provided, 

• self-reported development in identified areas of 
knowledge and skill, and for graduates and 
former students 

• current activities and an evaluation of the 
strengths/weaknesses of instruction received. 

Often such surveys are centrally administered by 
assessment offices. In other cases, they administered 
by different units across the campus, but are coor- 
dinated and partly supported through the assess- 
ment function. 

For the discussion of costs and benefits that follows, 
these functions will be assumed as the core of any institu- 
tional or state assessment program. Although the emphasis 
placed upon each of these activities may vary from institu- 
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tion to institution, they together repre^nt a minimum set of 
assessment functions addressed by such programs. 



2 

Some Caveats on 
Estimating the Costs and 
Benefits of Assessment 



In attempting a comprehensive review of the costs and 
benefits of institutional assessment programs, a number of 
initial observations and caveats are in order. Each places im- 
portant limits on what can meaningfully be accomplished. 

First, comprehensive programmatic assessment efforts 
of substantial duration are quite new. Fewer than a dozen 
institutions have operated such programs for a sufficient 
length of time for their consequences to become clear. The 
vast majority only initiated assessment activity within the last 
two or three years and are still in a planning, shakedown, or 
implementation mode. Consequently, their cost and payoff 
structures are different from those typical of fully established 
programs. Despite similarities in coverage and function, 
moreover, institutional assessment programs differ marked- 
ly in administrative organization. This means that they may 
also differ significantly in the way they account for invested 
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resources-particuJ rly those having to do with reassigned 
personnel. 

Second, because establishment of an explicit assessment 
function often involves a reassignment of existing activities, 
actually counting invested resources can be difficult. What 
is of interest is less the total cost of "assessment activity 0 than 
the net marginal investment in new assessment mechanisms 
established, plus ihe resource implications of reassigning 
old functions such as placement testing and student surveys. 
Moreover, because such existing functions are often scat- 
tered and inefficient, establishing a centralized coordinating 
mechanism can sometimes yield significant economies 
(Ewell and Lisensky 1988). As a result, past attempts to es- 
timate the cost of institutional assessment programs have 
concentrated on establishing the marginal costs of such 
programs, rather than the total investment required (for ex- 
ample Ewell and Jones 1986, Lewis and Wasescha 1987). 

Third, while the claimed benefits of institutional assess- 
ment are many, consistent valuation of these benefits is dif- 
ficult. This situation is shared by most analyses of higher 
education's uenefits: not only are dollar equivalents hard to 
come by, but estimates of benefit will vary considerably 
across different individuals with differing value structures 
and preferences (Howen 1980). As a result, there have been 
few definitive studies of concrete rate-of- return for invest- 
ments in instructional processes in colleges and universities 
beyond such relatively well-defined technical areas such as 
computer-assisted instruction. This situation considerably 
limits the applicability to assessment activities of formal 
"cost/benefit" techniques that compare the dollar values of 
investments with the dollar values of obtained results (Levin 
1983). 

Given this condition, past studies of the impact of par- 
ticular educational innovations or reforms have generally 
concentrated on one of two alternatives. Cost/effectiveness 
analyses examine invested costs in the light of some identifi- 
able common output or criterion measure for the activity in 
question. But with the exception of degree program comple- 
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tion, few common criterion measures exist for the outputs 
of higher education. Indeed) it is the very absence of such 
measures which in part inspires the call for outcomes assess- 
ment in the first place. The second alternative is to compare 
costs with H H*//tttes M -identifiable benefits which may vary in 
value across beneficiaries depending upon their individual 
goals and preferences. Here the primary intent of analysis is 
to determine which alternatives provide which kinds of 
benefits to which beneficiaries at what cost. While srch 
analyses do not provide unambiguous "cost/effectivencas 
ratios" upon which to decide what to do, they can neverthe- 
less provide considerable guidance for policy. At the very 
least, they provide a coherent framework for thinking sys- 
tematically about various available alternatives. 

Fourth, like benefits, costs may also be subject to incon- 
sistencies in valuation. In addition to identifiable fiscal and 
physical resources, the establishment of a new and con- 
troversial program may cost "political capital" or may cause 
considerable organizational friction over and above its ob- 
servable cost. Focusing institutional and faculty attention 
narrowly on the implementation of assessment may 
preclude other opportunities or may inhibit instructional in- 
novation or risk-taking. Like educational benefits, these ef- 
fects are sufficiently ambiguous that converting them into es- 
timated dollar equivalents may lose information. Beyond 
the issue of how much is invested there is that of who pays. 
Valuation of costs may vary significantly depending upon 
what particular partioat-interest actually have at stake in the 
process. 

Finally, the nature of assessment as a "management in- 
formation" activity means that it is a special kind of invest- 
ment-one not easily subject to the traditional rubrics of 
cost/benefit or cost/effectiveness analysis. Like all activities 
related to management, operating an assessment program 
involves the investment of real resources. These entail direct 
and observable costs to the institution. Benefits of informa- 
tion, however, are generally highly indirect. Literature on the 
"economics of information," for example, is founded on 
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management's use of information to make effective choices 
among posed alternatives-each of which itself has an as- 
sociated stream of costs and benefits (for example, Huber 
1980, Day 1978). If additional information cm increase the 
probability of choosing a "profitable" alternative, investment 
in obtaining this information is justified up to the point 
where the margin of incremental 'profit* disappears. But 
decisionmakers in higher education are rarely presented 
with such choices. Far more common is a situation where 
information-obtained at an invested cost-indicates that a 
particular deficiency is present and suggests some lines of at- 
tack toward addressing it. To address the deficiency, 
however, requires the investment of yet another increment 
of resources. Absent this second increment (or absent its 
being effective), prior investment in information may pay no 
dividends whatever. This is one reason why proponents of 
educational assessment and evaluation pay so much atten- 
tion to explicit mechanisms for connecting evaluation infor- 
mation to concrete decision processes, and to the use of in- 
formation. Without effective use, the "benefit" side of the 
analysis approaches zero. 

Taken together, these caveats suggest treating the costs 
and benefits of institutional assessment activities in the fol- 
lowing ways: 

• Costs are appropriately treated as programmatic 

costs-that is, the costs associated with a formal, estab- 
lished, identifiable activity with sufficient organizational 
and budgetary identity that resources can be consistent- 
ly accounted. 

• Costs are appropriately treated as marginal costs- 
that is the difference in investment between establishing 
an assessment program of given content and structure 
over existing information-gathering and utilization costs 
previously being incurred by the institution. 

• Costs are appropriately treated as the costs of assess* 
ment itself, not the costs associated with actually ad* 
dressing identified deficiencies; moreover, the costs 
of assessment are a part of any wider rate-of-return cal- 
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culation for the costs and benefits of any instructional 
improvement efforts in undergraduate education. 

Some 'costs," such as loss of access and reduction of 
risk-taking, are more appropriately treated as exter- 
nalities than as direct dollar costs; while it is in prin- 
ciple possible to obtain rough dollar equivalents for 
these negative effects, analysis is more meaningful if they 
are considered explicitly. 

A few claimed benefits of assessment, while difficult 
to render consistently in dollar terms, are sufficient- 
ly comparable across situations to in principle sup- 
port a cost/effectiveness estimate; where obtained 
results are comparable, for example in claimed increases 
in student persistence and graduation rates, cost/eftec- 
tiveness calculat.ons are appropriate. 
Most benefits of assessment are appropriately 
treated as "utilities" to particular constituents in the 
process, each of which may, (a) value obtained outcomes 
differently, and (b) pay different shares in the total in- 
vestment. 

These properties define the limits for the discussion that 
lows. 



Identifying Benefits, 
Costs, and 
Parties-at-Interest 



benefits of assessment have been claimed by proponents in 
bewildering variety. These range from improvements in 
specific cognitive outcomes for individual learners to broad 
societal benefits achieved by greater accountability to the 
taxpaying public. Similarly, "costs" of assessment have been 
raised by critics that encompass losses of opportunity for in- 
dividual students to politicization of higher education that 
distracts the enterprise from its fundamental ends. In order 
to make sense of these claims in determining the wisdom of 
embarking on various forms of assessment, an analytical 
framework encompassing the majority of these claims ;s rr- 
quired. 

Figure 1 provides the foundation for such a framework 
by arraying benefits and costs against a range of constituen- 
cies or "parties-at-interest." Henefits are roughly presented 
in terms of the degree to which they provide direct or in- 
direct payoffs to the identified party. Costs are noted its 
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Figure 1 

Benefits, Costs, and Externalities of Institutional Assessment 



Part its-* t -Interest 


Benefits 


Direct Costs 


Externalities 


Individual 
Students 


- Increases in 
knowledge/s kilt 

• Ina rases in 
graduation/ 
persistence 

• Increased 
credibility 
of degree 

- Better information 
for college choice 


• lesting Fees 


• Burdens of additional 
testing 

• Loss of access/choice 
of classes/programs 

- Loss of access due to 
biases and inequities 


Faculty 


• Targeted teaching 

- Better ability to 
design examinations 




- Burdens of designing 
and administering 
instruments 

• Perceived violations of 
"academic freedom" 


Institutions/ 
Programs 


- Improved curriculum 
structure and 

s cqucncc 

- Improved planning/ 
resource allocation 

- Increased faculty 
time committed to 
teaching 

- Enhanced ability to 
acquire resources 


• Full program 
cost, if 
unsupported 


- Narrowed curriculum/ 
"teaching to the 
test" 

- Opportunity costs of 
faculty time 

• Increased 
administrative 
"overhead" 


External 
Constituents 


• Enhanced employee 
skills 

o general 
o job-related 

• Better employee 
attitudes toward 
work 






General 
Public 


• Assurance that 
tax dollars are 
well spent 

• Increases in 
general welfare 


• Additional tax 
dollars to 
support total 
or partial cost 
of program 
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either direct dollar consequences or as "externalities" for 
which calculation of dollar equivalents are for the most part 
inappropriate. Parties-at-interest in this scheme are iden- 
tified as follows: 

• Individual students are individuals directly involved in 
higher education as "consumers," including currently en- 
rolled students, former students, a^d potential students. 

• Faculty are members of higher education faculties cur- 
rently or potentially involved in providing under- 
graduate instruction. 

• Institutions/Programs are colleges and universities as 
organizational entities, or subunits within institutions 
that can function relatively autonomously. 

• External constituents are organizations external to 
higher education that employ the graduates of colleges 
and universities and that stand to gain or lose because of 
skills or deficiencies possessed by graduates-either in 
general or in particular programs (these may include 
business/industrial employers, local governments, social 
service agencies, etc.) 

• The public are members of the general public (either as 
taxpayers or as the beneficiaries of improvements in 
general public weliure due to an educated public) and 
their elected representatives. 

Hach of these parties-at-interest may benefit or bear costs 
in different proportion depending upon the types of 
programs proposed. 

This framework is intended to serve two distinct analyti- 
cal purposes. First, it can serve as a guide for systematically 
summarizing existing arguments and evidence about the ac- 
tual impacts of institutional assessment programs. Review- 
ing this body of material cell by cell for different parties-at- 
interest will constitute the balance of this section. Second, 
the framework can be used to compare the benefits and costs 
of different proposed alternatives to particular constituen- 
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ties--for example a common state-mar dated basic skills 
placement examination against the establishment of incen- 
tives for institutions to create their own programs or the use 
of standardized tests or "curriculum* embedded" assessment 
alternatives for institutions. While such an analysis does not 
provide a definitive judgment about relative program cost/ef 
fectiveness, it will at least enable policymakers at the institu- 
tional or state level to select the most promising alternatives. 
Several such programmatic trade-offs will be considered in 
a following section, 

1. Benefits of Assessment by Identified Parties-at-In- 
terest: Benefits of assessment have been claimed and docu- 
mented in a variety of areas. Evidence for each will be brief- 
ly considered by potential beneficiary groups as outlined in 
Figure 1. 

a. Individual Students: Among the claimed 
benefits of establishing assessment programs for in- 
dividual students are the following: 

Documentable increases in knowledge and 
skills. Direct increases in student knowledge and 
skills are held to be a product of both the individual 
feedback on performance provided by testing, and of 
improved ability to target teaching on identified 
weaknesses in student abilities. Evidence from both 
state and institutional testing programs is fragmen- 
tary, out indicates that modest gains are partially at- 
tributable to assessment processes. In riost cases, 
however, these gains are confined to so-called "basic 
skills" areas-reading, writing and computation. In 
Florida, for example, demonstrable increases in stu- 
dent writing ability have been fissociated with the 
state's College Level Academic Skills Program 
(CIASP) which involves testing sophomores in basic 
skills as a condition for advancement (Cieres/ko 
1987; PEPC 1989). At institutions such as Northeast 
Missouri State University where repeated administra- 
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tion of a test instrument can document the "value 
added" of instruction, percentage gains in English 
subscores as measured by the ACT Assessment Ex- 
amination rose from 4.8% in 1978 to 10.6% in 1983; 
this period saw heavy investment by the university in 
enhancing assessment processes and in using the 
results to improve curriculum (McClain and Krueger 
1985). In both cases, benefits are somewhat offset 
by the fact that the test- taking populations became 
more able due to election biases: in Florida, less able 
students were deterred from taking the examination 
while at Northeast Missouri admissions standards 
rose in the same period. Similarly, it was not assess- 
ment alone that caused any increases but rather the 
combination of assessment and appropriate cur- 
ricular action. If used to inform curricular interven- 
tion, however, r modest gains in overall levels of basic 
skills can generally be expected. 

Increases in persistence and graduation rates 
due to improved advisement, placement and 
retention efforts. Student assessment programs 
have also been widely associated with gains in stu- 
dent persistence and graduation. This is due 
primarily to two different mechanisms. At the level 
of individual courses, coupling assessment of pre- 
requisite skills with course registration policies can 
result in significant increases in success rates. At 
North Carolina State University, for example, 
directed placement into selected mathematics and 
pre-engineering courses resulted in 30-40% in- 
creases in course passage rates overall, and over 70% 
increases for minority students (Hwell 1984b). 
Second, institution-level assessment results-par- 
ticular ly the results of student attitudinal and percep- 
tion surveys-can result in documen table increase..; in 
overall rates of student retention and degree comple- 
tion. At Northeast Missouri, for example, five-year 
degree completion rates have risen approximately 
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15% since initiation of comprehensive assessment 
(Northeast Missouri State University 1987), More 
typical, however, are the experiences of such institu- 
tions as Towson State University, Maryland and 
other members of two national student outcomes as- 
sessment projects in the early 1980's that increased 
retention rates by 8-10% overall in three years (Fwcll 
1984b; Kemerer, Baldridge and Green 1932), In- 
creased retention rates, of course, are of individual 
benefit in raising a given student's overall chances of 
obtaining a degree, and therefore of receiving the 
payoffs associated with degree completion. 

Increased credibility of the degree obtained* 
Another claimed benefit of assessment is public 
demonstration of the actual "learning content" of a 
baccalaureate degree (McClain 1984). Given con- 
siderable evidence of wide variations in student 
ability among the p oducts of different institutions, 
one claimed objective of student assessment is to 
provide concrete evidence of what students know 
and can do upon graduation. The claimed individual 
payoff in this case is increased competitiveness of 
graduates in the employment market. No concrete 
evidence currently exists to support this proposition 
beyond the generally better placement rates ex- 
perienced by graduates of some institutions par- 
ticipating in assessment. Much of this success, 
however, could equally be attributed to the fact that 
these institutions have simultaneously raised their 
admissions standards. 

Improved information for making initial college 
choices. Rather than affecting currently enrolled 
students, these benefits are held to accrue to poten- 
tial college students and their parents. Publicly avail- 
able information on attainment levels, success rates, 
and the placement experiences of graduates may 
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enable more informed consumer choices about 
which college or university to attend. The perceived 
success of graduates has traditionally been a major 
drawing card for "selective" institutions (Zemskyand 
Oedel 1983). Evidence that assessment results can 
to some extent offset entering student ability in the 
perceived attractiveness of an institution is provided 
by the increased application pools at such institu- 
tions as Alverno College, Kings College, and Nor- 
theast Missouri where assessment programs have 
been in place for a number of years. As above, 
however, these increases have been accompanied by 
highly visible innovations in curriculum in addition 
to assessment. 

b . Faculty: At the level of individual faculty mem- 
bers, few concrete benefits are claimed through assess- 
ment. Two, however, are of sufficient prominence to 
note below: 



Increases in the ability to target teaching on the 
identified needs of members of a given class- 
room. Faculty members at institutions such as Kean 
College, New Jersey and Kings College , Pennsylvania 
report that pre-assessments of student knowledge 
and ability significantly improve their ability to tailor 
instructional material to appropriate levels (for ex- 
ample, Farmer 1988). This allows important 
deficiencies in prerequisite knowledge to be quickly 
identified and dealt with before the term is too far 
advanced. It also allows adjustment in the timing 
and coverage of class content at an early point in the 
term. 



Increases in faculty ability to design and ad- 
minister classroom tests While the basic intent of 
comprehensive outcomes assessment programs is to 
examine performance across individual classes and 
students, significant numbers of faculty members at 
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all types in institutions report that the engagement 
in the design of assessment has improved their ability 
to design better tests for their own use (for example, 
Calhoun 1986; Banta 1985; Bantaand Moffett 1987). 
This experience has been a particularly apparent ef- 
fect of implementing assessment in the major field or 
department at research universities. Similar impacts 
have been reported with less frequency in general 
education at comprehensive colleges and liberal arts 
colleges (Curry and Hager 1987; Farmer 1988). The 
key here, however, is that faculty must have been ac- 
tively involved in designingand administering the as- 
sessment program, though there is some evidence 
that participating in commercial tests such as the 
ACT-COMP can also result in modest faculty develop- 
ment benefits (Banta 1986; Forrest 1982). 

c. Institutions/Programs: By far the greatest claims 
of positive benefit for systematic assessment have been 
at the institutional or program level. Among them are 
the fallowing: 



Improvements in the sequencing and structure 
of undergraduate curricula. Most institutions en- 
gaging in comprehensive assessment report sig- 
nificant early curricular changes as a result. Many of 
these changes, it is interesting to note, appear to have 
occurred as a result of designing the assessment 
(Banta 1986; Ewell 1984b). In several reported 
cases, curricular change pre-dated actual data collec- 
tion. Documented curricular changes resulting from 
assessment activities have been of three distinc t 
kinds. First, there have been notable changes in the 
sequence of particular courses making up particular 
curricula. For example, at Mt. Hood Community 
College, course order in several technology 
programs was reordered-yielding increases of 10- 
12% in degree completion rates (Hwell 1985); at the 
University of Tennessee, Knoxville, introductory 
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courses in several major fields were made mandatory 
(Banta and Moffett 1987). Second, assessment 
programs have in several cases led to identification 
and elimination of "soft-track" courses: at Northeast 
Missouri, elimination of such courses in mathematics 
and requiring students to take more solid math cour- 
ses resulted in visible gains in sophomore-level math 
test scores (McClain and Krueger 1985). Finally, as- 
sessment results have led to the introduction of new 
courses to address obvious curricular deficiencies: a 
good example is provided by the University of Ten- 
nessee, Knoxville where surveys of current and 
former students in Business indicated the need for 
courses in Business Law (Banta and Moffett 1987). 
In each of these cases, of course, the demonstrated 
link is between assessment and changes in the cur- 
riculum-changes that are presumed to benefit stu- 
dents in the form of increases in knowledge and 
skills. No direct evidence of such increases have as 
yet been demonstrated. 

Improved institutional planning and resource al- 
location. A second set of institutional benefits con- 
cerns the reported utility of assessment results in 
making better administrative decisions-particularly 
those involving program continuation, investment, 
and disinvestment. For these benefits to occur, there 
must be a strong linkage between assessment infor- 
mation and a regular and systematic process of 
program evaluation or review. At institutions where 
such linkages are present, both institutional ad- 
ministrators and program/department chairs report 
that better decisions are made about resource alloca- 
tion (Ewell 1984b). Consistent with overall mission 
and the results of strategic planning, investments are 
targeted toward identified deficiencies in curriculum 
in part discovered through assessment activities. 
Similar experiences have been reported by top ad- 
ministrators at the University of Tennessee, Knox- 



ville, where assessment results are also visibly used 
in the program review process (Banta and Fisher 
1984). In some reported cases, additional assess- 
ment information has determined a program con- 
tinuation decision which would otherwise have been 
different. At St. Petersburg Junior College, for ex- 
ample, information about post-graduate success and 
favorable employer ratings for graduates changed a 
Board decision about continuing an "inefficient" 
program in Social Work (Ewell 1985). 

Increases in faculty time committed to teaching. 
A number of observers have reported gains in facul- 
ty "time on task" expended in support of under- 
graduate instruction as a result of planning and im- 
plementing comprehensive assessment activities. 
Such reports have been particularly frequent with 
regard to general education--an area which often 
claims last priority in allocations of Faculty time and 
attention. In such cases, faculty report talking more 
with their colleagues about general education issues, 
discussing particular course content with greater fre- 
quency, and spending more time preparing for clas- 
ses and talking with students. Concrete evidence of 
this effect is scanty, however, and relies only on un- 
systematic self-reports from faculty and departmen- 
tal administrators. 

Enhanced ability for institutions to obtain addi- 
tional resources. Heightened interest in assessment 
per se has, of course, enhanced the willingness of 
both public and private hinders to provide resources 
to directly support such activities. Those institutions 
that have instituted programs early have generally 
been able to garner such funding-often in substan- 
tial amounts. More significantly, institutions that 
have collected assessment results over time have 
been able to use this information to make a better 
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case for budgetary requests from state governments 
and for special program requests from foundations 
and other hinders. In Missouri, for example, 
Northeast Missouri has consistently supported spe- 
cial appropriation requests from the legislature with 
a range of concrete assessment information-most 
recently in a library enhancement request (Krueger 
and Heisserer 1987). Interviews with state legislators 
in Missouri indicate thut the availability of such infor- 
mation was a significant contributor to the decision 
to fund the institution's request-both because it 
directly supported action and because it provided in- 
direct evidence of good management practice (Ewell 
and Boyer 1988). In Tennessee, legislators reported 
that the existence of the state's "performance fund- 
ing" program was important in obtaining increases in 
funding for higher education as a whole (Ewell 
1990). Similarly, Kings College, Pennsylvania has 
used its assessment program to obtain successive 
curriculum improvement grants from several nation- 
al and local foundations (Farmer 1988). 

d. External Constituents of Higher Education : A 
number of benefits of assessment are claimed for agen- 
cies and institutions that employ higher education's 
graduates. Few are to date substantiated by any direct 
evidence. They inclu 'e the tollowing: 

Increased assurance that potential employees 
possess requisite basic and higher order skills. 
Many institutions that employ college and university 
graduates have over the years been forced to design 
and implement their own testing programs to deter- 
mine the reading, writing, and computational skills 
of potential employees. I-argely they report im- 
plementing such programs because possession of a 
baccalaureate degree can no longer be taken as suf- 
ficient evidence that individuals possess required 
skills. Recently, for example, the US military ceased 
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to accept a college degree as the sole source of 
evidence about basic skills and is requiring special 
testing to determine skill levels among officer can- 
didates (Ewell 1984a). Credible higher education as- 
sessment would obviate the nted for such special 
testing programs, resulting in significant cost savings 
for employers. 

Increased assurance that potential employees 
who are graduates of specific job-related 
programs possess the special skills necessary to 
periorm effectively. This benefit parallels the 
above, but with respect to specific, identifiable, job- 
related skills. Institutions that have instituted end- 
of-program comprehensive examinations, practica, 
or projects in which job-related skills can be 
demonstrated in a real or simulated job setting have 
reported that potential employers are more likely to 
hire their graduates. Results of this kind have been 
particularly apparent in Nursing and other health 
professional training programs. As above, 
demonstration of skill before employment obviates 
the need for employers to "remediate" deficiencies 
after employment, again resulting in a potential cost 
savings. 

Increased assurance that potential employees 
- ossess appropriate attitudes toward work. In- 

easingly, employers report that they are concerned 
t whether otherwise well-trained college and 

■: :rsity graduates possess important job-related 
auitudes such as motivation, persistence, and inter- 
personal values that support teamwork. These con- 
cerns have been instrumental in the efforts of some 
professional program areas to explicitly stress the 
development and assessment of such attitudes while 
enrolled-for example the American Association of 
Collegiate Schools of Business. To the extent that 
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these efforts are successful, they are presumed to rep- 
resent a payoff to employers in the form of u more 
productive workforce (e.g., Bowen 1977). 

e. The General Public: Claimed benefits of assess- 
ment for the public at large rest largely on arguments of 
improved accountability. Specifically, assessment 
programs are held to be related to the following: 

Increased assurance that public tax dollars allo- 
cated to higher education are appropriately in- 
vested* Much of the argument for assessment from 
public officials rests on the proposition that the 
public has a right to know the effects of invested 
resources. Absent specific performance information, 
public accountability at least demands evidence of 
effective and prudent management of public 
enterprises. Assessment programs are argued on 
both grounds. Indirect evidence of the efficacy of as- 
sessment programs to fulfill the function is provided 
by the testimony of elected officials who report 
strong support of such programs for purposes of 
public accountability (Kwell 1990). 

Increases in general public welfare associated 
with other identified benefits. Many claims have 
historically been made about the general benefits of 
an educated citizenry. They include overall increases 
in social productivity, cultural and personal benefits, 
and avoidance of such negative social consequences 
as crime and social disruption (Bowen 1977). The 
majority of such benefits can be seen as "secondary 
effects" of one or more identified benefits above. 

2. Dollar Costs of Assessment: Despite the fact that as- 
sessment is relatively new as a distinct activity, its direct dol- 
lar costs can be more reasonably estimated than its claimed 
benefits. Partly this is because many associated costs are in- 
curred early, and can consequently be observed more readi- 
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ly. Partly it is because the basic ingredients of direct cost re- 
quired to operate assessment programs are comparatively 
well defined. As a result, several past attempts have been 
made to establish the direct costs of such programs (Ewell 
and Jones 1986; Conrad and Wilson 1985; Bowen 1985; 
Lewis and Wasescha 1987). It is important to note that these 
studies have themselves been used by several state govern- 
ments (for example, Virginia and New Jersey) to establish 
guidelines for funding institutional assessment programs. 
Consequently, actual available direct cost data has tended to 
converge in recent years: following Bowen 's analysis of ex- 
penditures in higher education (1980), the amount of fund- 
ing provided itself tends to determine "costs," because in- 
stitutions spend all of what they are given. Assessment 
programs ate no less subject to this observation than are any 
of the other things that institutions do. 

Any discussion of assessment costs involves two distinct 
topics. First, it is necessary to actually estimate the direct 
costs incurred-based on both the actual cost components of 
an assessment program and on an analysis of what institu- 
tions actually spend. Second, it is necessary to determine 
who pays these costs. 

a. Cost Estimates for Assessment: Two methods 
are generally used for arriving at estimates of program 
costs. The most frequent is "component costing" in 
which an estimate of total program cost is constructed 
by determining the costs associated with each of the 
program's requisite elements. A second method--"statis- 
tical costing"--involves analyzing a number of existing 
programs and calculating what is actually spent on 
program activities. Both methods have been used to es- 
timate the operating costs of institutional assessment 
programs. Due to small numbers of existing programs, 
however, statistical methods have to date been used only 
to confirm the estimates derived from component cost- 
ing. 

In implementing assessment programs, institutions 
incur costs in four areas. They include t' t following: 
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Instrument costs. Various cognitive exercises and 
student surveys constitute the technical basis for any 
assessment data gathering effort. Before they can be 
fielded, such instruments must be developed or ob- 
tained. If they are developed locally, costs are in- 
curred by faculty and measurement specialists. After 
initial development, such instruments can be 
produced on a regular basis-generally at lower cost 
than comparable commercial instruments. Institu- 
tions that have developed their own examinations 
have usually treated their construction as a 
departmental activity. Common practice, for ex- 
ample, is to provide each department with giants of 
$2 000-3 000 to cover the direct costs of test construc- 
tion. This practice tends to buiy many test-making 
expenses in ongoing departmental administrative 
budgets. If the full cost of such activity were calcu- 
lated, it would undoubtedly be higher than budgeted 
amounts. Commercial tests and surveys are usually 
purchased on a per unit basis. Costs range from a 
low of $7/instrument for such widely administered 
tests as the ACT Assessment to $75-$200/instrument 
for specialized field examinations. Costs for com- 
mercial cognitive instruments generally include 
analysis and scoring as well as acquisition of the in- 
strument itself. Commercial surveys are also general- 
ly purchased on a per unit basis, with costs ranging 
from $0.25/survey to approximately Jl/survey. 
When analysis services are also used, these costs 
average $3-$5/completed survey. In most cases, min- 
im uir orders or service charges of approximately 
$100 apply. 

Administration cost'*. Once acquired, tests and sur- 
veys must be administered to students. At some in- 
stitutions, existing testing centers established for 
placement or diagnostic testing nvy bear some of 
this burden. In most cases, however, the number of 
instrument to be administered will require re- 



sources beyond those available in existing testing 
centers. At minimum, test administration requires 
personnel to serve as proctors. Moreover, special 
equipment such as projectors and tape recorders 
may be required for some types of examinations (for 
example, the ACT-COMP), Survey questionnaires 
will either be administered in class or by mail. In the 
first case, direct costs of administration will be mini- 
mal-though some personnel costs will be incurred. 
In the second case, experience indicates incurred 
costs of $2-$3/completed instrument should be 
budgeted-an estimate that includes more than one 
follow-up mailing, possible telephone follow-up, 
and the costs of monitoring the follow-up process. 

Analysis costs. As noted above, commercial cogni- 
tive tests generally include analysis and processing 
expenses in the price of the instrument. Scoring and 
analytical services that cover the costs of data entry, 
computer analysis, and production of a simple sum- 
mary report are also available for most commercial 
surveys. To be of maximum use, however, obtained 
data will probably be analyzed locally, requiring ad- 
ditional personnel and data processing costs. This 
will be particularly true for locally-designed assess- 
ments, where data coding schemes and analyses must 
be designed from scratch. In the initial stages of such 
a process, considerable care must be taken to 
develop error-checking procedures and methods for 
handling incomplete or contradictory information. 
Once such procedures are put in place, however, on- 
going costs for analysis will be minimal-principally 
involving personnel and computer time. 

Coordination costs. Most institutional assessment 
programs involve establishment of a central function 
to coordinate a range of data collection activities and 
to provide technical assistance to departments and 
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units in designing, implementing, and interpreting 
the results of local assessments. Costs associated 
with establishing an office or function of this kind in- 
clude those for new professional and support staff, 
space to house these personnel, and ongoing operat- 
ing expenses. Established offices of this kind range 
from .5-2.0 FTE professional staff, depending upon 
institutional size, commitment, and the complexity 
of the program. In many cases, existing personnel 
are reassigned to provide staffing for an assessment 
center. Faculty with appropriate research back- 
grounds in the social or behavioral sciences, or test- 
ing/institutional research professionals may be taken 
from their current assignments and given respon- 
sibility for coordinating institution-wide assessment 
activities, designing instruments, or for analyzing 
and interpreting test and survey results. In such 
cases, the relevant cost consideration is that of 
replacing the reallocated staff member in his or her 
original function. 

7 Jased on these cost components, most past estimates 
of appropriate component costs for institutional assess- 
ment range from $7-$10/FTE student. Such estimates 
must be treated with extreme caution, however, as ap- 
propriate programs will vary greatly based upon institu- 
tional mission, the number and types of instructional 
programs offered, and characteristics of the student 
bcxly. Estimates will also vary greatly depending upon 
whether and how sampling strategies are used and the 
degree to which the institution has already developed ap- 
propriate entry testing and survey follow-up procedures. 

Statistical estimates of assessment costs based upon 
actual incurred costs at established institutions yield a 
somewhat higher estimate on a per-student basis. 
Program budgets for Northeast Missouri and the Univer- 
sity of Tennessee, Knoxville-both of which have 
operated identifiable assessment programs for over five 
years-average a bit over 510/FTE student annually. 
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Emerging institutional programs, for example those at 
James Madison University and Kean College, are current- 
ly incurring costs of about 112- 115/FTE student each 
year. In such cases, however, higher costs are expected 
because considerable instrument development is being 
undertaken in the program's first years. Institutional 
budgets for assessment submitted by all public institu- 
tions in Virginia in 1987 documented expected costs 
ranging from about 18/FTE to f 35/FTE. Funds actually 
allocated by the Virginia State Council for Higher Educa- 
tion for institutional assessment activity for next year 
averaged J12/FTE across institutions. 

b. Who Pays?: While the direct dollar costs of institu- 
tional assessment can be estimated with reasonable con- 
fidence within a range of 17-12/FTE student, the ques- 
tion of who bears these costs can vary considerably. Dif- 
ferent methods of allocating costs among the principal 
parties-at-interest will, of course, heavily determine their 
net payoff as a result of the activity. Existing institution- 
al practice has involved direct dollar costs incurred by 
one or more of the following: 



Individual students. Some institutions pass on the 
costs of assessment directly to individual students in 
the form of a testing fee. South Dakota's statewide 
assessment program, for example, is funded by a per 
student charge of $7/student, which covers all direct 
dollar costs of acquiring and scoring mandated in- 
struments (Boyer and E well 1988). Other individual 
institutions levy testing fees ranging from $7 to S9 
per student. Generally, the case for charging stu- 
dents is made on the basis of the direct benefits that 
students receive from the operation of a testing or as- 
sessment program. 



Faculty. While individual faculty members n ay 
incur considerable opportunity costs and may invest 
considerable time through their participation in as- 
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sessment, they do not generally tx:ar any dollar cost. 
Indeed, if the institution chooses to invest heavily in 
the development of local instruments, faculty may 
receive direct dollar payments for their involvement. 
Generally, however, these are in lieu of teaching and 
do not represent an increment of total income. 

Programs/Institutions. Where additional dollar 
support for assessment is not provided to institu- 
tions or programs for engaging in assessment--either 
through direct allocation or through a student fee 
structure-the cost of assessment must be directly 
bornt through reallocation. In most states, for ex- 
ample, the total cost of mandated institutional assess- 
ment must be supported by institutions themselves, 
as no new resources have been provided (Ewell, Fin- 
ney and Lenth 1990). Even in cases where some ad- 
ditional support is provided, it is often insufficient to 
cover the complete cost of the activity. Within institu- 
tions, for example, support provided to individual 
programs or departments for developing and pilot- 
ing a major field examination is approximately 
$2OOO-$3O0O. Given actual incurred costs, this 
amount may cover only half to two-thirds of the re- 
quirement. 

The public. To the extent that direct increments of 
dollar cost are not covered by student fees, they are 
ultimately incurred by taxpayers. On a per-taxpayer 
basis, however, such additional costs will be small 
compared to total payments for higher education. 
New Jersey's statewide College Outcomes Evaluation 
Project-currently the largest such statewide develop- 
mental effort-was budgeted at $850,000/year in 
1988-89. Virginia provided institutions with a total 
of $4.4 million for assessment in the 1988-90 bien- 
nium. Such investments are well within public 
program evaluation guidelines that call for the invest- 
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ment of 1-2% of total budget in evaluation activities, 
and well below typical corporate investments of 5-8% 
in research and development activities (Bowen 1977; 
Lewis and Wasescha 1987). 



3. Some "Externalities" of Assessment: Not all iden- 
tifiable negative consequences of assessment can be ap- 
propriately treated as dollar costs. Some represent negative 
individual or social consequences that could be costed out, 
but for analytical purposes are more beneficially identified 
individually. Examples include limits on access to higher 
education that disproportionately affect members of 
minority groups. Others represent demonstrated conse- 
quences of assessment that maybe negatively valued by some 
constituents but not so by others, or that represent truly non- 
quantifiable results. Examples include narrowed choices of 
programsor courses within curricula on the part of students, 
or limits on the freedom of individual faculty members to 
teach what they please as they please. Each of these iden- 
tified externalities is treated by its associated party-at-inter- 
est below. 

a. Individual Students: Among the negative conse- 
quences experienced by individual students attributable 
to assessment are the following: 



Increased burdens associated with testing exter- 
nal to the classroom. In cases where assessment is 
not built into the curriculum and involves addition- 
al testing or surveys, students pay a cost in lost time 
This cost is particularly apparent where assessment 
results are used solely to inform curricular or 
program decisionmaking and thus entail no in- 
dividual consequences or benefits for students 
(Banta 1988). The extent of this cost can be es- 
timated in two ways. First, the amount of time com- 
mitted can be directly estimated: for most institution- 
al assessment programs, time commitments for stu- 
dents will average three to four additional hours per 
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year. This resultcould becostedoutat prevailing stu- 
dent wage rates to obtain one estimate of lost 
benefits to students. Second, some institutions have 
attempted to pay students directly for participation 
in assessment: quoted amounts range from $10-20 
for a two or three hour testing session, generally held 
on an evening or weekend. It is important to note, 
however, that few students consider the reimburse- 
ment worth the effort. Indeed, widespread institu- 
tional experience with the difficulties of motivating 
students to commit time to assessment absent a 
direct evaluative consequence indicates this problem 
to be considerable for assessment programs that 
provide programmatic information only. 

Loss of access and choice with respect to desired 
courses or programs. Two kinds of negative conse- 
quences for students have been reported. First, if as- 
sessment results are used to restrict registration in 
particular courses and programs, individual students 
may be barred from attending. If the primary conse- 
quence is to give students the opportunity to 
remediate deficiencies so that they may subsequently 
successfully complete desired courses, this loss is jus- 
tified-although students may suffer time delays in 
completing their programs. But if a consequence is 
to deny access absolutely, a significant cost may be 
bome-particularly for members of minority groups 
who may perform poorly on formal assessments for 
a number of historical reasons. Second, if results are 
used to inform curricular decisionmaking, an impor- 
tant consequence may be to change the structure of 
curricula. This may result in elimination of preferred 
courses, or making more uniform the sequence in 
which particular courses are offered. Both limit 
choice on >he part of individual students as "con- 
sumers." Both may also imply that some students will 
take longer to complete their coursework. In both 
respects, moreover, assessment tends to result in cur- 




ricular changes that limit an individual student's 
"right to fail" 



Inappropriate limits on access due to embedded 
biases and inequities in assessment procedures* 
If assessment procedures are used for "gatekeeping" 
-that is to deny individual students access to par- 
ticular courses or programs, or to higher education 
generally-particular negative consequences may be 
experienced by members of identifiable student 
groups. Three types of students are generally men- 
tioned as negatively affected. First, experience has 
shown that members of minority groups may be ad- 
versely affected by testing, due to both cultural biases 
in testing procedures and to historic deprivations in 
educational opportunity. Where such inequities are 
apparent, students may not only be directly affected 
but may also withdraw from programs because of an- 
ticipated negative impacts. In Florida, for example, 
the CLASP program has resulted in a more than 50% 
decline in degree-seekers in community college AA 
Transfer programs (Ciereszko 1987; Losak and 
Wright 1983). Second, assessment procedures may 
not reflect important differences in learning style 
among students, and may consequently not ap- 
propriately classify them as deficient in certain skills. 
Finally, most assessment instruments, regardless of 
their actual content, are in fact predicated on a test- 
taker's language ability-particularly the ability to 
read English (Adelman 1988). This may imply dis- 
proportionate negative consequences for those with 
low verbal skills but with otherwise adequate 
abilities, or for those whose native language is not 
English. 



b. Faculty Members: Negative consequences of as- 
sessment identified for individual faculty members are as 
follows: 
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Increased burdens involved in designing assess- 
ment instruments, administering such instru- 
ments, and interpreting results. Emerging ex- 
perience indicates that significant investments of 
faculty time are involved in designing appropriate as- 
sessment activities. Commitments are especially 
heavy when faculty-designed instruments are used. 
For institutions that have accounted for such time, 
estimates of this commitment approximate one 
quarter of a full-time faculty equivalent term teach- 
ing load to develop a local departmental examination 
or assessment procedure. Institutions such as Kean 
College, New Jersey, the College of William and Mary, 
Virginia, or Kings College, Pennsylvania that rely 
heavily on faculty scoring of local instruments report 
heavy time commitments in assessment--ap- 
proximately eight additional hours per term to grade 
such instruments. In both cases, however, it is argu- 
able that this investment is part of regular teaching 
assignments because it is also part of the student 
grading procedure. Indeed, at an institution like Al- 
verno College, distinctions between "assessment" 
and "teaching" h^.e no meaning; both are part of the 
established curriculum. For other institutions, 
however, assessment may involve an added time 
commitment on the part of faculty that is seen as es- 
sentially unrelated to classroom instruction. This is 
more likely the case where commercial instruments 
are used. 

Perceived violations of academic freedom. As- 
sessment involves establishing inherent limits on 
what a faculty member can do in his or her classroom. 
As noted above, one impact is to change curriculum 
structure and content to ensure greater continuity 
among courses (and particularly across different sec- 
tions of the same course). Some faculty may see this 
as a threat to their individual autonomy as reflected 
in the concept of academic freedom. It is important 



to note that no legally sustainable case for violations 
of academic freedom has historically been heard on 
this basis, and that the concept refers only to a facul- 
ty member's right to express personal opin ions in the 
classroom; no case can be legally made for a faculty 
member not teaching assigned material, or for not 
teaching effectively. Nevertheless, confusions over 
the precise meaning of "academic freedom" in the 
minds of some faculty often cause notable and im- 
portant political opposition to assessment. 

c. Institutions/Programs: Negative consequences 
at the institution or program level associated with estab- 
lishing assessment programs have been noted in several 
areas. They include the following: 



Excessive limitations on curriculum content and 
"teaching to the test." One claimed benefit of as- 
sessment lies in its impact on curriculum-particular- 
ly in areas of structure, sequencing and uniform con- 
tent. Where this process is deemed excessive, it is 
also seen as a negative impact. If assessment results 
are taken too seriously in determining what should 
be taught, there is a fear that only "measurable" con- 
tent will be included. If results have significant con- 
sequences for the fates of individual students, 
moreover, incentives are strong to tailor instruction 
to the examination rather than viewing performance 
on the examination as representative of a broader 
range of student knowledge and abilities. Evidence 
from Florida indicates that the CIASF program has 
had a recognizable impact on the teaching of fresh- 
man courses in English and Math in Florida public 
institutions. Higher pass rates on the examinations 
maybe the result, but some faculty fear thatareas not 
assessed by the examination are as a result being 
crowded out of the curriculum. 
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"Opportunity costs" of substantial Investments of 
faculty time. Time spent by faculty in developing as- 
sessment instruments, administering them, and in- 
terpreting the results have already been noted as 
potential negative consequences for individual facul- 
ty members. In addition, the institution or program 
must consider the alternative uses of faculty time that 
such investments preclude. Generally these are cited 
in terms of lost time for research and public service 
activities. While no data is available to estimate the 
impact of such diverted effort, faculty members at the 
University of Tennessee, Knoxville»the only public 
research institution with substantial experience with 
student assessment-have been reluctant to invest 
substantially in assessment programs for more than 
a three-year period. Moreover, where assessment is 
external to the classroom and also involves a faculty 
time commitment, less time may be available for ac- 
tual instruction. In several institutions where com- 
mercial examinations are used, for example, one 
classroom period per term is used to administer the 
examinations diversion of from 2-4% of overall in- 
structional time. 

Increases in administrative "overhead" as- 
sociated with creating a new function. If assess- 
ment is undertaken as a distinct and visible activity, 
as mandated by many states, it may require estab- 
lishment of an explicit office and associated report- 
ing structure. This may entail costs and externalities 
beyond those associated with the tangible assets in- 
vested in the program. Examples of such externalities 
include increases in administrative complexity due to 
establishment of an additional office or function, dif- 
ficulties of coordination with other units assigned to 
collect information aboutaspects of institutional per- 
formance, and possible duplicative reporting bur- 
dens on academic units (Ewell 1988). While such ad- 
ditional costs can be minimized through a com- 
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prehensive approach to institutional management 
information and planning functions, emerging ex- 
perience has shown that incurring such costs is like- 
ly~particularly in the early stages of establishing an 
institutional assessment program. 
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Applying the Framework 
to Some Policy Choices 



As emphasized throughout the prior discussion, derivation 
of a single cost/benefit estimate for all assessment programs 
is both impossible and inappropriate. Difficulties in consis- 
tently specifying costs and benefits in dollar terms, differen- 
ces among proposed "assessment" programs in different in- 
stitutional settings, and differences in the ways key par- 
ticipants value similar outcomes conspire against such a 
simple answer. What is possible is to use identify; le costs, 
benefits, and externalities to help sort through proposed 
policy alternatives. Two pairs of such alternatives are brief- 
ly discussed in this section-one for institutions and one for 
states-using the proposed framework as a guide. 
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Two Institutional Policy Alternatives 

Assessment Using Available Instruments 

One popular early option for institutions electing to em- 
bark on assessment is to found the program on existing 
standardized tests and surveys, most of which are commer- 
cially available. This approach has major virtues of proven 
technique and available normative data to inform com- 
parisons, though it also has many drawbacks. The best 
known current example of this approach is Northeast Mis- 
souri State University (McClain and Krueger 1985); 
Tennessee's statewide "performance funding" program in- 
volves establishment of institutional programs with similar 
characteristics (Banta 1986). Among the institutions cur- 
rently embarking upon assessment in response to state man- 
date, somewhere between one third and one half initially 
adopt such an approach. Its basic features include, a) ad- 
ministration to selected samples of students commercially 
available general education examinations such as the ACT- 
COMP, ACT-CAAP, or the ETS Academic Profile, b) ad- 
ministration to graduating seniors the ORE or ETS Major 
Field examination that corresponds to their major or ad- 
ministration of a relevant professional licensing or profes- 
sional school admissions test znd, c) administration to 
samples of current students, graduating seniors, and/or 
recent alumni an available survey such as the ACT Evaluation 
Survey Service (ESS), the NCHEMS/College Board Student 
Outcomes Information Service (SOIS), or the 'KllA College 
Student Experiences Questionnaire (CSEQ). 

Figure 2 presents major areas of benefit and cost for this 
alternative. Using the categories of benefit, cost, and exter- 
nality previously discussed for each party-at-interest, the 
figure roughly indicates the presence and intensity of each. 
Particularly notable are the following: 
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Figure 2 

Benefits, Costs, and Externalities of Institutional Assessment: Institutional Programs 
Case 1: Available Standardized Tests and Surveys 
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Benefits. Benefits of this alternative are due primarily 
to the perceived external credibility provided by the use 
of standardized instrumcncs. Partly this is because in- 
struments available through "third party" testing agen- 
cies such as the Educational Testing Service (ETS) and 
the American College Testing Program (ACT) are 
removed from direct institutional interest and can there- 
fore be presumed to be more "objective/ Partly it is due 
to the ability of standardized tests and surveys to provide 
a basis for evaluating comparative performance, For in- 
dividual students, primary benefits are therefore in the 
area of better "consumer information" for college choice; 
Northeast Missouri, for example, was able to attract an 
increasingly more talented entering student body partly 
on the basis of the credibility provided by its assessment 
program. For faculty and institutions/programs, benefits 
are more mixed, Changes in curriculum and "targeted 
teaching" have been widely reported in Florida institu- 
tions as a result of "rising junior" examinations, but these 
responses are seen as both positive and negative depend- 
ing upon the observer's value position. Clearly, 
however, the credibility of such a program can strongly 
benefit an institution in the acquisition of resources. In- 
stitutions such as Northeast Missouri that have adopted 
this approach can point to an impressive record of addi- 
tion-to-base funding from state authorities. 

Costs. Direct dollar costs for a testing program of this 
kind have been estimated in the range of $7/student 
(Kwell and Jones 1985)* This estimate assumes the use 
of "average cost" standardized instruments and testing 
samples of students rather than entire populations. In 
most cases, these costs have been covered through avail- 
able institutional contingency funds (or, as in the case of 
Tennessee, are drawn from revenues "earned" through 
favorable test performance). In some cases, student fees 
are levied (in South Dakota institutions, for example, 
$15/student in 1989-90). 
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• Externalities. Primary externalities of this approach fall 
on individual students because in most cases stand- 
ardized testing involves the sacrifice of out-of-cla&s time 
and results in information which is of limited utility in 
enhancing individual student learning. Indeed, many 
obtained scores are not individually valid as the instru- 
ments are designed to produce group scores. At the same 
time, if scores are valid and used, students may lose ac- 
cess to particular courses or their progress impaired be- 
cause of their performance. In such cases as well, there 
will likely be allegations of test bias if minority groups 
experience substantial adverse impact. These two ef- 
fects, however, will occur only if the testing program 
functions as u gateway" for students; the majority do not 
do so, and the major cost to students is in the form of 
time and effort that might have been invested elsewhere. 
For faculty and programs, externalities are minimal as 
this approach rarely involves additional effort. Perceived 
violations of "academic freedom" can be considerable-- 
particularly if class time is used for test administration 
and if results are applied in an attempt to change class 
coverage or instructional practice. In addition, there will 
often be charges that available standardized tests do not 
adequately reflect what is actually taught. Both of these 
objections will likely be stronger in the major field than 
in general education, and are least strong with respect to 
surveys (Banta 1985). For the most part, however, facul- 
ty externalities will be minimal compared to administra- 
tive overhead costs. This approach, for instance, virtual- 
ly requires establishment or enhancement of a testing/as- 
sessment office with responsibility for test coordi nation, 
scheduling, and reporting. For even a small institution, 
this function may require at least an additional one-half 
FTE administrative position. 

This pattern of benefits, costs, and externalities assumes 
an "ideal type" program based solely on available instrumen- 
tation-an alternative which very few institutions actually 
adopt. More common is a "mixed" approach where stand- 
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ardi/ed assessment instruments are used in some major 
departments and not others, according to the wishes and 
needs of their respective faculties. Where this occurs, many 
externalities can be avoided-particularly those associated 
with perceived violations of academic freedom and student- 
experienced burdens of testing. In general education, use 
of standardized instruments is often seen as an institutional 
"path of least resistance" for developing a credible program 
in response to state mandate. In these cases, faculty are rare- 
ly directly involved in the decision to proceed and the 
primary benefits, costs, and externalities of the program are 
experienced primarily among administrators. Line faculty 
may know little about the program and about how it 
operates. 

Locally-Designed "Curriculum-Embedded" Assessment 

An increasing number of institutions developing assess- 
ment programs are choosing to design their own instru- 
ments and to as fully as possible integrate assessment 
techniques with established points at which performance in- 
formation is already collected. In the cognitive arena, this 
implies designing "curriculum-embedded" or "course-em- 
bedded" assessment techniques in which representative ex- 
amples of student performance in regular coursework or ex- 
aminations are collected and evaluated. In some cases, spe- 
cially-designed examination questions are prepared for ad- 
ministration as part of the final examinations of regular clas- 
ses; answers are used to both assign course grades and are 
scored for consistency with wider curricular objectives. In 
other cases, representative "portfolios" of existing student 
work are regularly collected and analyzed in a similar 
fashion . In both cases, a major benefit is that student motiva- 
tion is unaffected: students know that their work will count 
for course grade credit, so are more inclined to do their best. 
Non-cognitive data-gathering is s s milarly integrated into 
regular data collection mechanisms and procedures. Exist- 
ing questionnaires, such as those typically administered tc; 
current students by Student Affairs Offices to determine their 
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satisfaction with provided services, or those typically ad- 
ministered to graduates by Alumni Offices to determine cur- 
rent status and activities are often extended to include a 
range of non-cognitive developmental items (Ewell and 
Lisensky 1988). Another example of using existing oppor- 
tunities is to extend the coverage of end-of-course question- 
naires already administered to students for purposes of 
faculty evaluation, 

Figure 3 presents primary areas of benefit, cost, and ex- 
ternality associated with this approach. The categories used 
are those of the previous section, and again an "ideal type" 
assessment program is assumed. 

• Benefits. Direct benefits of this alternative accrue 
primarily to faculty and students. Experimental valida- 
tion work at Alverno College, for example, has repeated- 
ly substantiated the efficacy of faculty-designed assess- 
ment techniques in helping to produce gains that can r>e 
documented exv^rnally-often through subsequent ad- 
ministration of standardized measures or performance 
in the workplace (see Mentkowski and Doherty 1984). 
Other institutions have documented increased pass-rates 
on professional licensure examinations as a partial result 
of increased local assessment. For individual faculty 
members, particular benefits have been in the area of im- 
proved "iest-making" skills. At Kean College in New Jer- 
sey for example } a key secondary effect of "course-em- 
bedded" assessment in general education has been facul- 
ty-reported improvements in constructing their own ex- 
aminations; similar effects are reported at the University 
of Tennessee, Knoxville, but are largely confined to those 
departments where faculty actually designed examina- 
tion questions (Banta 1986). Closely related are faculty- 
reported benefits related to curriculum structure. In 
cases where faculty must design their own assessment 
processes, they must first refine their curricular objec- 
tives; often this process in itselfcan lead to improved cur- 
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Figure 3 

Benefits, Costs, and Externalities of Institutional Assessment: Institutional Programs 
Case 2: LocaUyDesigaed "CurrlculunvEmbedded n Assessment 
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ricular coherence and course structure. In contrast, this 
approach generally shows little of the short-term exter- 
nal payoff associated with the test-based alternative. 
Most faculty-designed instruments are initially not seen 
as credible by outside authorities. 

• Costs. Direct dollar costs of programs of this kind are 
uncertain because most costs are already embedded in 
institutional operations. The majority must be counted 
in the reallocation of faculty time. At an institution like 
Alverno, for example, it is difficult to determine what as- 
sessment "costs" because all faculty are doing it as a 
natural and regular part of teaching. Clearly, however, 
direct charges for students will be minimal. Equally 
clearly, incremental costs for designing and coordinating 
a new activity will have to be borne by the institution- 
either through reassignment of faculty time and/or 
through the employment of coordinating personnel and 
testing-measurement specialists to assist the faculty. Be- 
cause such activities are arguably a part of teaching, 
moreover, they are less likely to be supported through 
increased revenue provided by the state. Indeed the 
recent trend among state initiatives is in the opposite 
direction: to require institutional assessment, but not to 
provide additional funding to institutions to pay for it 
(Ewell, Finney, and Lenth 1990). 

• Externalities. Externalities associated with this ap- 
proach are also largely concentrated among faculty and 
at the institution/program level. Just as direct dollar 
costs under this approach are difficult to estimate, the 
total amount of faculty time invested can prove con- 
siderable-particularly in the initiative's early stages. Not 
only is the investment considerable, but it is also likely 
to be unevenly distributed; most institutions rely heavi- 
ly on the efforts of a few committed faculty members to 
serve as a core group during the program's initial years. 
Usually, such faculty serve as members of a multi-func- 
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tional (and often overworked) "assessment task force" or 
are drawn from the faculty of initial "pilot" departments 
undergoing assessment on an experimental basis. In the 
long term, "burnout" among this group can be con- 
siderable. For other faculty, devoting the needed time 
to develop meaningful local assessment processes may 
mean taking faculty time away from other things. Be- 
cause both the coverage and technology of assessment 
are determined by faculty themselves, this appn^ach may 
avoid some of the political opposition encountered by 
approaches based on standardized testing thtt are held 
to violate far Ity autonomy. But the integrated approach 
does compel faculty to agree on common teaching ob- 
jectives, and this in itself may not be easy. At the same 
time, administrative overhead costs for assessment may 
equal those associated with a test-based approach be- 
cause so many diverse activities must be coordinated. 

Again, the above discussion assumes adoption of an 
"iderl type" program in which all assessment is developed lo- 
cally. Most actual institutional programs will mix features of 
this approach with the use of existing standardized instru- 
ments and surveys. For the most part, the decision of which 
features to adopt is based upon local needs and expedients. 
Occasionally, however, institutions will consciously elect to 
adopt a mixed approach in order to maximize the different 
kinds of benefits associated wish each approach. They may, 
for example, use local assessment for most departmental 
evaluation, but occasionally administer standardized instru- 
ments to small samples of students in order to help "validate" 
their local processes (for example, Mentkowski and Doher- 
ty 1984). Similarly, they may employ consultants from na- 
tional testing or assessment organizations not only to help 
faculty design better instruments, but also to help "certify" 
that local procedures are credible and sound. 



53 



Two State Policy Alternatives 

Statewide Testing of Basic Skills 

One leading set of state-level policy alternatives with 
respect to assessment centers on the perceived need to 
detect and remediate students entering higher education 
deficient in such basic skills as reading, writing, and com- 
putation. Statewide programs of this kind are currently in 
place in New Jersey, Tennessee, and Texas, and are being ac- 
tively discussed in several other states. Basic features of such 
programs include, (a) use ofa single standardized basic skills 
examination by all institutions in the state, (b) prohibitions 
against the use of results to deny admission to institutions, 
(c) use of results to place students assessed as deficient into 
appropriate remediation programs, and (d) exit testing of 
students using the same instrument on completion of 
remediation. 

Figure 4 presents major areas of benefit and cost for such 
a program. Again using categories of benefit, cost, and ex- 
ternality discussed in the previous section for each party-at- 
interest, the figure roughly indicates the presence and inten- 
sity of each. Particularly notable are the following: 

• Benefits. Program benefits will occur particularly for in- 
dividual students in the form of documentable increases 
in knowledge and skills at the basic level and in increased 
chances of graduation. But both benefits, it is important 
to note, will only occur if remediation and associated 
placement are also successful-they are not direct results 
of the assessment program perse. Some benefits should 
also result for faculty, who are better enabled to teach at 
the appropriate level rather than being required to con- 
stantly remediate in the classroom. Moreover, external 
constituents and the general public will receive secon- 
dary benefits in the form of greater assurances about the 
skill levels of college students and greater accountability. 
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Benefit *, Costs, and Externalities of Institutional Assessment: State Programs 
Case 3: Statewide Testing of Basic Skills 
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• Costs. Overall dollar costs for a testing program of this 
kind can be estimated from past experience in New Jer- 
sey and emerging experience in Texas. Both incurred 
initial test development costs in excess of one million 
dollars. Operating costs are about $9-11/ student tested, 
or about $4/enrolled FTE student. How such costs 
should be paid is another matter. Both states currently 
fund the program out of general revenue. This entails a 
direct cost to taxpayers as well as an opportunity cost to 
institutions t hat might have received this funding for al- 
ternative purposes. Alternatively, direct costs could be 
passed on to students in the form of fees. In this case, 
there is a further choice between spreading the fee across 
all enrolled students as part of a tuition payment, or ap- 
plying it only to those tested as they are tested. The lat- 
ter alternative would have the advantage of clarity, but 
would be particularly burdensome for those assessed as 
deficient and forced to leave the institution. 

• Externalities. A program of this kind will probably en- 
tail a range of negative externalities. For individual stu- 
dents, all three potential side-effects would be present. 
Certainly, total test-taking time would increase; evidence 
from New Jersey and emerging evidence from Texas sug- 
gest, for example, that institutions now administer both 
the statewide Basic Skills test and their own local ".ce- 
ment examinations. Moreover, many students w..! be 
denied their initial choice of classes or programs because 
of deficient performance; in New Jersey, more than a 
third of test takers are assessed as deficient in one or 
more basic skills each year. If deficiencies are detected, 
directed placement may significantly increase the 
amount of time it may take a student to obtain a degree. 
Major negative impacts, however, would likely be initial- 
ly incurred in the form of faculty opposition and "teach- 
ing to the test." 

This overall pattern might be significantly changed if 
particular features of the proposed program were sub- 
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ject to modification. For example, changing the require- 
ment that a single, statewide instrument be used would 
markedly reduce faculty opposition and teaching to the 
test. Negative impacts would remain in these areas, but 
would likely be not so strong. Allowing institutions to 
use their wn instruments, moreover, would also reduce 
the burden of testing for individual students. It would 
not, however, provide as much payoff in accountability 
to the general public as would a program based upon 
common testing. 

Changing the requirement that students be tested on 
exiting from remediation would also shift the payoff pat- 
tern for the program as a whole. Because of a 
demonstrable association between directed placement 
and persistence, individual benefits would not be so 
strong as in the base program, and the benefits as- 
sociated with assuring external constituents and the 
public that college students possess basic skills would 
evaporate. At the same time, externalities such as teach- 
ing to the test and perceived violations of academic 
freedom would be all but eliminated. 

Requiring Institutions to Undertake Local Assessment 

As noted earlier, the center of gravity for most state-based 
assessment efforts has been to require institutions to design 
and implement their own local assessment programs (Kwell, 
Finney and Lenth 1990). Current assessment efforts in Vir- 
ginia, Colorado, Missouri, South Dakota, New York, Arizona, 
Kansas, and many other states are consistent with this pat- 
tern. While many variations in what is required are apparent 
across the many suites where such plans are in place, their 
general payoff pattern is presented in Figure 5. Once again, 
standard categories of benefit, cost, and externality are used. 
Notable features are as follows: 

• Benefits. Most of the documentable benefits of this al- 
ternative are centered in the curriculum-particularly in 
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Figure 5 

Benefits, Costs, and Externalities of Institutional Assessment: State Programs 
Case 4: Requiring Institutions to Design and Implement Local Assessment Plans 
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improvements in curricular structure and sequence. 
Benefits to individual students are certainly present, but 
documentable increases in knowledge and skill will be 
difficult to claim. Some external benefits will also be 
present, but the primary focus on internal evaluation and 
improvement will also imply that obtained information 
is less directly useful to external constituents. All these 
benefits, of course, will depend heavily upon what the 
institution in fact proposes to do. Absent information on 
graduate placement, for example, benefits associated 
with consumer choice will largely disappear. Effective 
"packaging" of information intended largely for internal 
management, however, can also serve to demonstrate ac- 
countability to the public (Ewell 1990). 

Costs. Overall costs for programs of this design are in 
the standard estimated range of J7-12/FTE student. 
Once again, however, the question of who should bear 
these costs has a number of answers. Student fee alter- 
natives, as practiced in South Dakota, seem comparative- 
ly inequitable because individual students do not 
generally receive proportionate direct benefit. Requir- 
ing institutions to fully absorb these costs as part of their 
existing budget, as practiced in most states, may require 
substantial reallocation and associated opportunity 
costs. Where such programs are substantially supported 
by additional dollars, as for example in Virginia and New 
Jersey, an additional burden is placed on the taxpayer, 
who may or may not receive commensurate payoff in the 
form of accountability and improvements in general wel- 
fare. In practice, many states share such costs between 
institutions and taxpayers-appropriating limited addi- 
tional funds to support local assessment, or using exist- 
ing categorical grant or non-base incentive funds to sup- 
port a range of institutional efforts. 

Externalities. The most important negative consequen- 
ces associated with this alternative occur for faculty and 
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for institutions. For faculty, a major consequence is a 
considerable investment of time in the design of assess- 
ment instruments and in scoring and interpreting the 
results of local examinations. Although each institution 
is free to choose its own approach, m-ny faculty will also 
feel threatened in the initial stages of the program. Both 
these consequences may change depending upon the 
kinds of assessment instruments used: faculty-designed 
instruments will increase faculty burden and reduce op- 
position; commercial standardized tests (even if chosen 
by faculty themselves) will increase the perceived threat 
but will substantially reduce direct faculty burden. For 
the institution, moreover, substantial costs may be in- 
curred in establishing an additional administrative func- 
tion. 

This pattern can also be substantially altered by 
changing one or more features of program design. For 
institutions, the payoff structure shifts markedly depend- 
ing upon the percentage of direct costs that is covered 
by additional resources. If the full cost of the program 
must be absorbed, most institutions will see such a 
program as a "breakeven" proposition at best; most will 
therefore initially resist its adoption as state policy. For 
faculty, opposition and burden are directly affected by 
the kinds of approaches proposed-particularly the de- 
gree to which they rest upon standardized testing and 
the level of choice that faculty are allowed in choosing 
appropriate assessment instruments and techniques. 
Fmerging experience seems clear on the point that some 
degree of faculty opposition will be experienced no mat- 
ter what kind of program is proposed. It is also clear, 
however, that the greater the degree of faculty involve- 
ment, the more likely curricular benefits will be. 

For individual students, however, few features of the 
program's design will cause a shift in preference: most 
benefits are indirect, and because assessment results are 
not used to determine the fates of individual students, 
important externalities are absent. The major exception 
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here is cost, as given uncertain individual payoffs, it will 
be difficult to argue that individual students should bear 
a substantial cost burden for this activity. 



5 

Conclusion 



Choosing an appropriate course of action in an area as com- 
plex as assessment is a process influenced by many factors. 
Institutions and state systems must be guided not only by 
their own information needs, but also by their respective his- 
tories, resource contexts, and cultures. Formal considera- 
tion of the benefits, costs and externalities that have been ex- 
perienced by others facing the same set of choices can be in- 
formative, but it can never be definitive. Many of those 
charged with implementing assessment have found that a 
systematic review of the factors noted in this monograph is 
helpful in sorting through available options, and they are ad- 
vanced in this spirit. Ultimately, however, each institution or 
system must act in its own way, and must develop an ap- 
proach to assessment that best meets its own unique needs 
and conditions. 
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